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(64) Method of presorting visual 
information 

(57) A method and apparatus are da* 
closed for presenting visual information 
to an operator. The apparatus compris- 
es a movable camera (13,14) for pro- 
ducing an image or means for produc- 
ing an Image which simulates that 
produced by a movable camera, A 
monitor (19,20) presents the image to 
the operator In such a wqy that the 
location of the Image in apace moves in 
correspondence with the movement of 
the movable camera or simulation 
thereof. The operator may be provided 
with means for moving the monitor, 
such movement being sensed and 
caused to produce corresponding 
movement of the camera. The appar- 
atus may be used, inter alia, for con- 
trolling and observing movement of e . 
vehicle (12) which carries a manipulator 
(11). 
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SPECIFICATION 

Method of presenting visual Information 

5 This invention relates to a method of presenting 
visual information, for example information sup- 
plied by a television camera or a computer- 
generated simulation of a scene. 
There are many situations in which visual informa- 

10 tion has to be presented to an operator indirectly, le. . 
with the operator not directly observing the scene 
• concerned. One such situation arises In the handling 
of dangerous substances which may be carried out 
remotely by a manipulator. One or more movable 

15 television cameras feed images back to the operator 
who controls the manipulator accordingly. Another 
situation where the Indirect presentation of visual 
Information Is involved is In the control of unman* 
ned submersible craft which are widely used for 

?0 carrying out inspections on and around sea-based 
oil rigs. Here, movement of the submersible craft Is 
controlled by an operator who la presented with 
visual Information by cameras movably mounted on 
the craft. Yet another such situation arises where the 

25 operator Is In 8 vehicle whose movement he is 
controlling, but where the operator is unable to view 
his surroundings directly but must do so via televi- 
sion cameras. Many other comparable situations can 
arise In other fields. 

30 Typically the operator of a remote manipulator 
faces one or more television monitors receiving 
images from one or more cameras mounted near the 
manipulator. He is able, by means of knobs or 
joy-sticks, to control the direction of at least some of 

35 the cameras, the position of the manipulator and, in 
the case of a manipulator mounted on a remotely 
controlled vehicle, the motion of the vehicle itself. 
Similar considerations obtain where what Is In- 
volved is a remotely controlled vehicle not having a 

40 manipulator thereon. 

One of the chief difficulties encountered in practic- 
al operation of such systems Is that the operator 
becomes disorientated after prolonged operation or 
in an unfamiliar environment, or one poor Jn visual 

45 dues. The reason forthis is thatthe television image 
does not contain any direct information about the 
position of the camera or its orientation. Such 
Inf ormaton can be deduced only through the inter- 
pretation of the arrangement of the objects within 

50 the image. This, of course, is possible only if either 
the objects and their arrangement are familiar or if 
an accurate record of all the motions of the camera 
and the vehicle has been kept. In practice this means 
that If the operation is taking place in an unfamiliar 

55 environment and the vision Is not continually clear 
or the operator not continually watching the image 
the situation will Inevitably arise when the positional 
information wilt be lost Similar difficulties arise 
where what is being presented is a computer* 

60 generated simulation of a scene. 

A system Is known for presenting visual Informa- 
tion to an operator, in which the Image produced by 
a moving camera appears on a screen which Is 
attached to a helmet worn by the operator. The 

65 screen occupies the entire field of view of one or 



both eyes. As theoperator moves his head this is 
sensed and caused to produce a corresponding 
movement of the camera. However, this system has 
been found to induce very considerable fatigue tn 
70 the operators, who find it unpleasant for one or both 
eyes to be constantly deprived of a view of their 
Immediate real environment. 

According to the present Invention, there Is pro- 
vided a method of presenting to an operator visual 

76 information representing a scene viewed by a mov- 
ing camera or a simulation thereof, wherein the 
Information Is presented as an Image whose location 
In space is movable, the said Image and the camera 
or simulation thereof moving in spatial correspond* 

80 ence with one another. 

The Invention also provides an apparatus for 
presenting to an operator visual information derived 
from a movable camera or from means for produc- 
ing an Image which simulates that produced by a 

86 movable camera, the apparatus comprising means 
for presenting the image to the operator in such a 
way that the location of the Image In space moves, 
the said Image and the camera or simulation thereof 
moving in spatial correspondence wfth one another. 

90 The Invention further provides an apparatus for 
presenting visual information to an operator, com- 
prising a movable camera for producing an image or 
means for producing an imagewhich simulates that 
produced by a movable camera, and means for 
95 presenting the Image to the operator in such a way 
that the location of the image in space moves, the 
said Image end the camera or simulation thereof 
moving In spatial correspondence with one another. 
Preferably the image is movable with respect to 

100 the head of the operator. 

With correct choice of system parameters, e.g. 
viewing distance, lens focal length and so forth, the 
image will appear to present to the operator a 
moving window on an otherwise stationary scene. In 

105 this way the problem of disorientation disappears or 
is at least alleviated. 

Some embodiments of the invention are shown In 
the accompanying diagrammatic drawings, in which 
each of Figures 1 to 5 la a diagrammatic perspective 

110 view of one embodiment 

Figure 1 shows an operator 1 viewing a television 
monitor 2 which presents to the operator an image 
provided by a movable camera (not shown) 
mounted to survey a scene located remotely from 

115 the operator. For example, the camera could be 
mounted to observe a. manipulator located in a 
remotely located room. The operator controls the 
operation of the manipulator by means of a joy-stick 
3 mounted on a console 4. The monitor 2 is mounted 

120 adjacent the operator 1 on arms 30 for pivotal 
movement about a vertical axis defined by a shaft 5 
and about a horizontal axis defined by a shaft 6. The 
operator can move the monitor 2 manually by 
means of a handle 7. Movement of the monitor is 

125 sensed by sensing means (not shown) which trans- 
mit to the remotely located camera a signal to cause 
corresponding movement of the camera. The oper- 
ator thus indirectly control movement of the 
camera by means of the handle 7, Because the 

130 monitor 2 and the remote camera move in synchro n- 
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ism the operator has the illusion of viewing a 
moving window on an otherwise stationary scene. 

Figure 2 shows .a modification of Figure 1 de- 
signed to reduce the inertia of the system. Here, the 
5 monitor 2 is mounted away from the operator 1 near 
the shafts defining its axes of rotation and is viewed 
by a lightweight mirror 8 connected to the monitor 2 
by an arm 31. 
Figure 3 shows a modification which uses a 
10 television image projected on a screen 9 by a 

projector 1 0. Figures 1 , 2 and 3 each show the use of 
- a single camera/ but to provide a wide angle view a 
plurality of cameras could be used, each with its own 
display. 

1 6 Figure 4 shows the use of the invention in 
controlling the movements of a manipulator 1 1 
which is mounted on a vehicle 12. Two television 
cameras 13 and 14 are provided, the camera 13 
being arranged to survey a worJcpiece 15 on which 

20 operations are to be carried out, and camera 14 
being arranged to provide a close-up view of the 
area adjacent the manipulator, for which purpose 
the camera 1 4 is arranged to move with the manipu- 
lator 1 1 , The operator 1 sits in a cab 16 which is 

25 mounted on a base 21 and is provided with controls 
17. 18 for controlling movement of the vehicle 12 
and a joy-stick 3 for controlling the manipulator 1 1 . 
Two monitors 19 and 20 are mounted on the cab 16 
for movement with the cab and for movement with 

30 respect to the cable. Operation of the joy-stick 3 
causes the manipulator 1 1 to move carrying the 
camera 14 with it and corresponding movement of 
the monitor 20 is produced either directly by the 
movement of the joy-stick 3 or indirectly by feedback 

35 from the movement of the manipulator 11, Opera- 
tion of the controls 17, 18 causes movement of the 
vehicle 12. Angular components of this movement 
are detected by appropriate means, for example 
gyroscopes mounted on the vehicle 12, and a signal 

40 representing these components is transmitted to a 
drive which is capable of moving the cab 1 6 wfth 
respect to a base 21 on which It is mounted. This 
movement corresponds to the angular components 
of movement of the vehicle 12 so that the orientation 

45 of the cab 16 changes to match changes in the 
orientation of the vehicle, in this way the operator 
experiences changes of direction and orientation of 
the vehicle 12 which are produced by external 
factors, e.g. irregularities In the surface on which It is 

50 travelling, as well as by the steering controls. If the 
operator wishes to move the cameras 13 and 14 with 
respect to the vehicle 12 he does so by moving the 
monitors 19 and 20 manually. The sensed move- 
ment of the monitors produces a corresponding 

55 movement of the cameras. 

Figure 5 shows part of a modified version of the 
embodiment of Figure 4. The modification of Figure 
5 is to dispense with the cab 16 and substitute an 
overhead motor drive 24 for moving the monitor 19. 

50 The overhead motor drive 24-is operated by a servo 
connection, Indicated dlagrammatlcally by numeral 
22, which connects the overhead motor drive 24 to 
the movable platform 23 on which the operator's 
chair is mounted. The servo connection 22 enables 

85 the monitor 19 to move in synchronism with move- 



ment of the platform 23, except insofar as the 
operator himself moves the monitor 19 by means of 
the handle provided. The provision of the overhead 
motor drive 24 offers the possibility of moving the 

70 monitor 19 with respect to platform 23 by means 
other than the handle Illustrated. For example, the 
motor 24 can effect such movement in response to 
movement of a joy-stick (not shown), in response to 
voice commands detected by a speech-recognition 

75 system, or In response to movement of a helmet 
worn by the operator as detected by an appropriate 
sensor. 

Although the Invention has been described above 
chiefly in relation to information provided by televi- 
80 sion cameras. It must be emphasised that it is also 
applicable to simuated visual images produced, for 
example, by computer simulation. 

CLAIMS 

85 

1. A method of presenting to an operator visual 
information representing a scene vfewed'by a mov- 
ing camera or a simulation thereof, wherein the 
information Is presented as an Image whose location 

90 in space fs movable, the said image and the camera 
or simulation thereof moving In spatial correspond- 
ence with one another. 

2. An apparatus for presenting to an operator 
visual information derived from a movable camera 

95 or from means for producing an image which 
simulates that produced by a movable camera, the 
apparatus comprising means for presenting the 
image to the operator in such a way that the location 
of the image in space moves, the said image and the 
100 camera or simulation thereof moving in spatial 
correspondence with one another. 

3. An apparatus according to Claim 2, wherein 
the movement of the image presenting means Is 
about two orthogonal axes. 

1 05 4. A apparatus according to Claim 3, wherein the 
(mage presenting means is mounted adjacent the 
location to be occupied by the operator on at least 
one arm connected to the means defining the said 
axes. 

110 5. An apparatus according to Claim 2 or 3, 
wherein the image presenting means is mounted 
away from the location to be occupied by the 
operator, and a mirror for viewing the image pre- 
senting means is mounted adjacent the said location 

115 and connected to the image presenting means for 
movement therewith. 

6. An apparatus according to Claim 2 or 3, 
wherein the image presenting means is arranged to 
project the said image onto a screen for viewing by 

120 the operator. 

7. An apparatus for presenting visual informa- 
tion to an operator, comprising a movable camera 
for producing an image or means for producing an 
image which simulates that produced by a movable 

125 camera, and means for presenting the image to the 
operator in such a way that the location of the imaga 
in space moves, the said Image and the camera or 
simulation thereof moving in spatial correspond- 
ence with one another. 

130 8. An apparatus according to Claim 7, wherein 
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the movement of the Image presenting means (9 
about two orthogonal axes. 
' 9. An apparatus according to Claim 8 r wherein 
the image presenting means is mounted adjacent 
5 the location to be occupied by the operator on at 
least one arm connected to means defining the said 
axes. 

1 0. An apparatus according to Claim 7 or 8, 
wherein the image presenting means is mounted 

10 away from the location to be occupied by the 
operator, and a mirror for viewing the image pre- 
senting means la mounted adjacent the said location 
and connected to the image presenting means for 
movement therewith, 

15 11. An apparatus according to Claim 7 or 8, 
wherein the Image presenting means is arranged to 
project the said image onto a screen for viewing by 
the operator. 

12. An apparatus according to any one of Claims 
20 7 to 1 1, wherein the image presenting means 

comprises a monitor movable by the operator, the 
apparatus comprising means for sensing movement 
of the monitor an means, responsive to the said 
sensing means, for moving the camera or simulating 
25 movement of the camera. 

13. An apparatus according to any one of Claims 
7 to 12, further comprising means operable by the 
operator for controlling a movable tool positioned in 
the field of view of the movable camera. 

30 14. An apparatus according to Claim 13, wherein 
the movable camera is mounted for movement with 
the tool. 

15. An apparatus according to Claim 13, wherein 
the movable camera is so mounted that the tool Is 

35 movable with respect to the camera. 

1& An apparatus according to any one of Claims 
7 to 12, for use where the operator is to control 
movement of a vehicle on which the movable 
camera is mounted, comprising an operator station 

40 defining the location to be occupied by the operator, 
operating-controlled means for controlling the 
movement of the vehicle, and means for effecting 
angular moverhant of the operator station to corres- 
pond with anguta r movement of the vehicle. 

45 17. An apparatus according to Claim 16, wherein 
the means for effecting angular movement of the 
operator station comprises means for sensing move- 
ment of the vehicle to correspond therewith. 

18. An apparatus according to Claim 16 or 17, 
§0 wherein the operator station comprises a cab on 

which the image presenting means is mounted. 

19. An apparatus according to Claim 16 or 17, 
wherein the image presenting means is mounted 
independently of the operator station and is opera- 

55 tively connected to the operator station for move* 
ment In synchronism therewith. 

20. An apparatus according to any one of Claims 
16 to 19, for use where the vehicle carries a movable 
tool, wherein an additional camera is mounted for 

60 movement with the tool and an additional image 
presenting means is provided for the operator to 
view the image produced by the said additional 
camera. 
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